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Abstract 

In this paper, we study asynchronous consensus problems of continuous-time multi- 
agent systems with discontinuous information transmission. The proposed consensus 
control strategy is implemented only based on the state information at some dis- 
crete times of each agent's neighbors. The asynchronization means that each agent's 
update times, at which the agent adjusts its dynamics, are independent of others'. 
Furthermore, it is assumed that the communication topology among agents is time- 
dependent and the information transmission is with bounded time-varying delays. 
If the union of the communication topology across any time interval with some 
given length contains a spanning tree, the consensus problem is shown to be solv- 
able. The analysis tool developed in this paper is based on the nonnegative matrix 
theory and graph theory. The main contribution of this paper is to provide a valid 
distributed consensus algorithm that overcomes the difficulties caused by unreliable 
communication channels, such as intermittent information transmission, switching 
communication topology, and time- varying communication delays, and therefore has 
its obvious practical applications. Simulation examples are provided to demonstrate 
the effectiveness of our theoretical results. 
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1 Introduction 



In recent years, decentralized coordination of multi-agent systems has become 
an active area of research and attracted the attention of multi-disciplinary re- 
searchers in a wide range including system control theory, statistical physics, 
biology, applied mathematics, and computer science. This is partly due to its 
broad applications in cooperative control of unmanned aerial vehicles, schedul- 
ing of automated highway systems, formation control of satellite clusters, dis- 
tributed optimization of multiple mobile robotic systems, etc. 

In cooperative control of multiple agents, in order to accomplish some compli- 
cated tasks or reach their common goals, groups of dynamic agents in multi- 
agent/multi- robot systems need to interact with each other and eventually 
reach an agreement on certain quantities of interest. Those problems are usu- 
ally called consensus problems, which are one of fundamental research topics 
in decentralized control. 

Consensus problems have been studied for a long time and the formal investi- 
gation of them can be traced back to 1960's in the field of management science 
and statistics (See DeGront [1] and references therein). In the field of systems 
and control theory, the pioneering work was done by Borkar and Varaiya[2] 
and Tsitsiklis and Athans[3], which is on asynchronous consensus problems 
with an application in distributed decision- making system. In [4], Vicsek et 
al. proposed a simple but interesting discrete-time model of multiple agents 
moving in the plane. Each agent's motion is updated using a local rule based 
on its own state and the states of its neighbors. The Vicsek model can be 
viewed as a special case of a computer model mimicking animal aggregation 
proposed in [5] for the computer animation industry. By using the graph theory 
and matrix theory, Jadbabaie et al. provided a theoretical explanation of the 
consensus property of the Vicsek model in [6], where each agent's set of neigh- 
bors changes with time as the system evolves. The typical continuous-time 
consensus model was presented by Olfati-Saber and Murray in [7], where the 
concepts of solvability of consensus problems and consensus protocols were 
first introduced. In [7], under the assumptions that the dynamics of each 
agent is a scalar continuous-time integrator and the communication among 
agents may be unidirectional, Olfati-Saber and Murray used a directed graph 
to model the communication topology and studied three agreement problems, 
namely, directed networks with fixed topology, directed networks with switch- 
ing topology, and undirected networks with communication time-delays and 
fixed topology. And it was assumed that the directed topology is balanced 
and strongly connected. In [8], Ren and Beard extended the results of [6] 
and [7] and presented some improved conditions for state agreement under 
dynamically changing directed interaction topology, which is not necessarily 
balanced or strongly connected. In the past several years, consensus problems 



2 



of multi-agent systems have been developing very fast and several research 
topics have been addressed, such as agreement over random networks [9,10], 
asynchronous information consensus [11,12], dynamic consensus [13], consen- 
sus filters [14], networks with general communication structures [15], networks 
with nonlinear agreement protocols [16], and networks with switching topol- 
ogy and time-delays [6,7,8,16,17,18,19,20]. For more details, see the survey 
[21] and paper [22], where a theoretical frame- work for analysis of consensus 
algorithms for multi-agent networked systems was provided. In addition, it is 
necessary to emphasize that flocking of agents and swarms[23,24,25,26] and 
formation control of vehicles[27,28,29] are two active areas where many useful 
results obtained in consensus problems have been successfully applied. And in 
[23] , the authors provided the first proof of convergence of Reynolds' rules on 
the basis of the convergence of consensus algorithms in [7]. 

In this paper, we propose a distributed asynchronous consensus control strat- 
egy that is only based on the state information of each agent's neighbors at 
some discrete times. This is partly motivated by the work of Olfati-Saber 
and Murray [7] and the difficulties encountered in the implementation of the 
typical continuous-time protocols proposed in [7]. In the realistic networks of 
agents, we may face the following problems: 

(1) Communication topology is always changing; 

(2) The received information is often with time-delays, and furthermore, the 
delays may be (randomly) time-varying and unknown; 

(3) Due to long distance transmission, unreliable information channels, and 
limited bandwidth of networks, the continuity of state information of each 
agent's neighbors cannot be ensured. 

Here, we summarize some important closely related works. First, in continuous- 
time systems, none of the existing results guarantee the stability of the consen- 
sus protocols proposed by Olfati-Saber and Murray, in the presence of switch- 
ing topology and time- varying delays. It was often assumed that the available 
topologies are finite[6,7,8] and the delays are constant [7,16,17]. In fact, the sta- 
bility analysis of the protocols in [7] in the presence of time-varying delays is 
challenging and even impossible in theory, and is unnecessary in applications. 

In the study of discrete-time systems, Tanner and Christodoulakis in [20] 
studied a discrete-time model with fixed undirected topology and assumed that 
all agents transmit their state information in turn. Consequently, outdated 
information may be used and the equivalent augmented system becomes a 
periodically switched system, which can be viewed as a multi-agent system 
with switching topology. In [11], Fang and Antsaklis studied the case with 
switching topology and time-dependent delays by an asynchronous system 
with fixed topology. However since the possible topologies are generated by 
the fixed topology of the asynchronous system, the "switching" topology is 



3 



not really switching. By matrix theory, Xiao and Wang derived some sufficient 
conditions for the solvability of consensus problems of discrete-time systems 
with switching topology and time- varying delays in [19], but it was assumed 
that all available topologies are finite. 

In addition, all the proposed continuous-time consensus algorithms depend 
on continuous state signals. In engineering applications, continuous signals 
require large bandwidth of networks, and furthermore, in many cases, are 
not available. Therefore, we need to devise some continuous-time consensus 
algorithms that do not continuously depend on the external state information. 

Our proposed consensus control strategy is built upon very general assump- 
tions. The communication topology is switching among an infinite set of 
weighted directed graphs, communication delays are time-varying, and state 
information transmission is allowed to be intermittent. Moreover, our control 
strategy is also an asynchronous one, which means that each agent's update 
actions are independent of others'. Each agent adjusts its dynamics indepen- 
dently, which is inherent in distributed control systems. It is important to 
mention that asynchronous consensus problems were also studied by [2,3] 
and [11], where several asynchronous consensus algorithms were given. By 
using nonnegative matrix theory and graph theory, especially the properties 
of scrambling matrices, we provide some sufficient (and necessary) conditions 
for the convergence of our consensus control strategy. 

This paper is organized as follows. Section II presents some basic definitions 
and results in matrix theory and graph theory. Section III formulates the 
problem to be studied. Convergence analysis and the technical proof are per- 
formed in Sections IV and V, respectively. In Section VI, simulation examples 
are presented. Finally, concluding remarks are stated in Section VII. 



2 Preliminaries 

This section presents some definitions and results in matrix theory and graph 
theory that will be used in this paper [30,31]. 

Let X n = {1,2,- •• ,n}, Z + be the set of nonnegative integers, and 1 = 
[1, 1, • • • , 1] T with compatible dimensions. Given A = [a^] G R nxr , A is said 
to be nonnegative, A > 0, if all its entries are nonnegative. A is said to 
be positive, A > 0, if all its entries are positive. Let B e R nxr . We write 
A> B A — B > 0, and A> B ii A — B > 0. A nonnegative square matrix 
A with the property that all its row sums are +1 is said to be a stochastic 
matrix. Throughout this paper, we let njLi A — A k A k _i • • • A 1 denote the left 
product of matrices. A n x n stochastic matrix A is called indecomposable and 
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aperiodic (SIA) (or ergodic) if there exists /6lR" such that lim^oo A k = lf T . 

Directed graphs will be used to model the communication topologies among 
agents. A directed graph Q consists of a vertex set V(G) = {fi, V2, • • • , v n } and 
an edge set £{G) C {(vi, Vj) : Vi, Vj G V(G)}, where an edge is an ordered pair 
of vertices in V(G) (Here, we allow for self-loops, namely, the edges with the 
same vertices). The set of neighbors of vertex Vi in Q is denoted by Af(G,Vi) = 
{vj : (vj,Vi) G £(G),j 7^ i}- The associated index set of the neighbors is 
denoted by Af(G, i) = {j : Vj G J\f(G, Vi)}. If (vi, Vj) is an edge of G, Vi and Vj 
are defined as the parent and child vertices, respectively. A subgraph Q s of a 
directed graph Q is a directed graph such that the vertex set V(G S ) C V(G) and 
the edge set £{G S ) C £(G)- If V{G S ) = V(G), we call Q s a spanning subgraph 
of £?. For any v u Vj G V(£? s ), if (vi,Vj) G £(</ s ) if and only if (vi,Vj) G £(£), 
Q s is called an induced subgraph. In this case, C/ s is also said to be induced by 
V{G S )- A path in a directed graph £ is a sequence i^, • • • , Vi k of vertices such 
that (vi s , Vi s+1 ) G V(G) for s = 1, • • • , k — 1. A directed graph Q is strongly 
connected if between every pair of distinct vertices Uj, u,- in there is a path 
that begins at and ends at Vj (that is, from to fj). A directed tree is 
a directed graph, where every vertex, except one special vertex without any 
parent, which is called the root vertex, has exactly one parent, and the root 
vertex can be connected to any other vertices through paths. A spanning tree 
of G is a directed tree that is a spanning subgraph of G- We say that a graph 
has (or contains) a spanning tree if a subset of the edges forms a spanning 
tree. A weighted directed graph G(A) is a directed graph G plus a nonnegative 
weight matrix A = [a^] G R nxn such that (vi,Vj) G £(G) dji > 0. And 

dji is called the weight of edge (vi,Vj). 



3 Problem Formulation 

We suppose that the system studied in this paper consists of n autonomous 
agents, e.g., birds, robots, etc., labeled 1 through n. All these agents share a 
common state space R. Each agent adjusts its current state based upon the 
information received from other agents that are defined as neighbors of this 
agent. We use a weighted directed graph G(A(t)) to represent the communica- 
tion topology or information flow, where A(t) = [s^j(t)\ G R nxn is a nonneg- 
ative matrix. The appearance of parameter t implies that the communication 
topology may be dynamically changing. Agent i is represented by vertex t>j. 
Edge (vj,Vi) G £(G(A(t))) corresponds an available information channel from 
agent j to agent i. If agent i receives information from agent j at time t, then 
there exists an edge from vertex Vj to vertex v^, i.e., (vj,Vi) G £(G(A(t))). 
And the neighbors of agent i are those agents whose information is received 
by agent i at time t. The associated index set of the neighbors is denoted by 
M(t,i). Notice that because of the existence of communication time-delays, 
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the index set J\f(G(A(t)), i) may not be equal to Af(t, i). We will discuss them 
latter. 

Let Xi G R denote the state of agent i and let x = [xi,x 2 , ••• ,x n ] T . Then 
the whole system can be generally represented by the continuous-time model 
x(t) = f(t, u(t)) or by the discrete-time model x(t+ 1) = f(t, u(t)), where u(t) 
is a state feedback. If for any initial state, x(t) converges to some equilibrium 
point x* (dependent on the initial state) such that x* = x* for all i,j G X n , 
as t — > oo, then we say that this system solves a consensus problem[7] (or 
has the consensus property). Let x : -> R be a function of n variables 
Xi, X2, • ■ ■ , x n . For any initial state x(0)JZl if x* = lx(x(0)), then we say that 
this system solves the x-consensus problem, and the function x is called the 
consensus function. The common value of x* is called the group decision value. 



3.1 The Model 



For agent i, i G Z n , we assume that it receives or detects its neighbors' states 
at update times tf , t\, ■ ■ ■ , tf k , ■ ■ ■ , which can be seen as a real number sequence 
and are denoted by {%}. We assume that {tf k } satisfies the following assump- 
tions: 

(Al) For any k G Z + , < f u < t l k+1 — t\ < f u , where f u , f u G R; 
(A2) f = 0. 

The simple reason for the calling of "update times" is that the neighbors' infor- 
mation known by agent i or the dynamics of agent % is updated at those times. 
The existence of lower bound f u of time intervals between any two consecutive 
update times is just to guarantee the validity of our consensus protocols (1) 
and (2). If there does not exist lower bound, it will be hard to analyze proto- 
cols (1) and (2) in theory and it is also unnecessary in applications. If there 
does not exist an upper bound f u of f k+1 — f k , it will be difficult for the states 
of agents to reach consensus (See Example 1). For Assumption (A2), we make 
it solely for the convenience of our theoretical analysis; otherwise, the main 
results of our paper is still obtainable. 

If agent i receives the state information of its neighbors at t l k , then agent i is 



2 In this paper, consensus functions are only related to the systems without time- 
delays. 
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assumed to take the following dynamics in time interval [t l k ,t l k+1 ) 

a ij (*! ) 



Xi(t) 



0, otherwise. 



Remark 1 The continuous-time model studied in [7] is that Xi(t) = X^eA/Yt,*) a y(^) 

In ow discrete-communication framework, this system will turn 
into Xi(t) = £jejv(t,i) a^- (^X^fc) - accordingly, where t G [t k ,t\ +1 ). 

Seemingly, our model (1) is a special case of this one. But if system (1) solves 
a consensus problem, then the afore-mentioned system will also have the con- 
sensus property. That will be clear in our analysis process. 

It is well known that communication time-delays exist extensively in networks. 
Therefore, it is reasonable to assume that there exist communication time- 
delays in the information transmission. For agent i, i G I n , we assume that 
the information received by agent % from agent j is with time-delay at 
update time t\, and then the considered system turns into 



0, otherwise. 



where t G [44+i)- 

We make the following assumption about system (2) together with Assump- 
tion (Al, A2): 

(A3) < r£ < r d = Kf u , where i G J n , j G J^(t{, i),k,Ke Z+; 

Remark 2 Consider system (2). Generally, the time-delays may be unknown 
for each each agent when they receive information. If the data is time stamped, 
the delays will be detectable. In addition, if communication time-delays only 
satisfy Assumption (A3), for any i G T n , j G N{t l k ,i), the state information 
of agent j , Xj{t k — r^) 7 received by agent i at update time t k may be outdated 
compared with state information Xj(t' k , — T^) received previously, i.e., t k — r^ < 
t k , —t¥, where k' < k. If the delays are detectable, we can suppose that agent i 
always uses the most recent data of its neighbors, that is, if there exists k' < k 
such that t\ — Tj°j < t\, — , then agent i replaces the state information Xj (t k — 
rfj) by Xj(t k * — tJ°*) in time interval [t\,t\ +1 ), where k* = argmax. k '<k(t k > — 
t¥). We call this control strategy the-most-recent-data strategy. This control 
strategy can get better convergence rate (See Example 3). 
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According to different properties of update times, we classify systems (1) and 
(2) as synchronous or as asynchronous systems. 

Definition 1 (Synchronous and asynchronous systems) We say that sys- 
tem (1) (or (2)) is synchronous if for any i,j G X n , {f k } = {t{}, i.e., for any 
k G Z +7 t\ — t? k . We say that system (1) (or (2)) is asynchronous if for any 
i,j G X n , i 7^ j, {t\} is independent of {t{}, i.e., agents may not adjust their 
dynamics at the same time (See Fig. 1). 

In realistic networks, it is difficult for all agents to be synchronous on update 
actions and therefore we mainly discuss the asynchronous consensus property 
of systems (1) and (2). 

3.2 Communication Topology 

Since our consensus protocols (1) and (2) only depend on discrete state infor- 
mation, we are not concerned with the actual communication topology Q(A(t)) 
outside those update times. And we give the following definition of Q°(t), 
which is different from the actual communication topology and is also called 
communication topology. 

Definition 2 (Communication topology) Suppose that G°(t) is with the 
same vertex set as Q(A(t)). For any i G X n , k G Z +; if agent i receives the 
state information of agent j at time tf k , j ^ i,j G X n , then (vj,Vi) G G°(t), and 
if not, (vj,Vi) G" G°(t), where t G [t l k ,t l k+1 ). In addition, there are no self-loops 
ing°(t). 

In Definition 2, G°(t) is only compliant with the actual topology G(A(t)) 
on those edges corresponding to s^j(t l k ), i G X n ,j G Af(t k ,i). This way can 
facilitate our theoretical analysis and does not affect the dynamics of agents. 

Proposition 1 Af(t%, i) = U{Q°{%), i) C M{G{A{%)), i). 

The above proposition follows from the fact that the available channel (vj, Vj) 
at t\ can not ensure that agent i can receive the state information of agent j at 
time t\ if there exists time-delay, and agent i cannot receive any information 
from agent j if (vj,Vi) does not exist. 

Remark 3 The reason for the introduction of G°(t) is that G°(t) is more 
important than G(A(t)) for our control strategies. We can see that G°(t) is di- 
rectly connected with the successful information transmission in the networks. 
£{G{A{t))) represents all available communication channels, while £{G°{t)) 
stands for the communication channels through which the information has 
been successfully received. 
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Here, for simplicity of presentation, we introduce another matrix A(t) = 

E J6 v(t*,o ' if tffa q ^ > and a . = 

0, j = i 

if N{t l k ,i) = (f>, t G [*fe, ifc.fi)- Obviously, A(i) is stochastic. 

i, i = « 

Proposition 2 Foranyt>0,N{G{A{t)),i)=N{G Q (t),i). And if we ignore 
the weight of each edge in Q(A(t)) and self-loops in Q(A(t)), then Q(A(t)) 
and Q°(t) represent the same graph. 

Since G{A(t)) may be dynamically changing, we should investigate all possible 
directed graphs. Because of the finite number of vertices, there are at most 
2 nxn different kinds of directed graphs. Let Tg denote the set of all those 
directed graphs. Assume the existence of real number a > a > 0, such that 
a < a ij{t) < a if SLij(t) 7^ 0. Consequently all possible A(t) constitute a 
compact se denoted by Fa, and if ^ 0, then t^thi < a *i(^) ^ 1- It 

is important to note that all possible communication topologies are infinite if 
we take the weight of each edge into account. 

Finally, we present the notion of the union of graphs that will be used in the 
remainder of this paper. 

Definition 3 (Union of graphs) The union of graph Q°(t) across time in- 
terval [t°,t° + T] is a directed graph with the same vertex set as G°(t) and 
the edge set \Jt'e[t°,t°+T] £(G°(t'))- The union of graph G°(t) on the time set 
{si, 82, - - • , Sfc} is a directed graph with the same vertex set as G°(t) and the 
edge set Ui=i£(G°(si)) ■ 



4 Convergence Results 



This section presents the main result of this paper. As a preparation for the 
study of the general case, we first investigate two relatively simple cases: the 
synchronous system with fixed topology in the absence of time-delays and the 
asynchronous system without time-delays. Our approach is to transpose the 
continuous-time systems into their discrete-time counterparts, which possess 
the same consensus property as the original systems. The obtained discrete- 
time systems have some special structures and the proof of their consensus 
property is postponed to the next section. 

3 The set of all r x s matrices can be viewed as the metric space R rs and compact 
sets are equivalent to bounded closed sets. 
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Some notations are used in this section. If the studied systems are free of 
time-delays, we let {t k } = {t\,i G I n ,k G and if the systems are with 

time-delays, let {t k } = {t k or t\ 
t = and tk+i > tk- Let Tk = 



-Tfj,i el n ,k g Z 4 
tk+i — tk, k G Z H 



, j G A/"(4,i)}, such that 
, and let A(A) = {B = 



[bij] G R nxn : for any i,j G J n ,&. 



Oij, or 6^ 



0}, where A = [o^] G R r ' 



Obviously A (A) is a finite set. Let IT(m, t) denote the set of matrices 

e -fc/ + (i _ e-^A^t) (1 - e- h )A 2 (t) • • • (1 - e^A^t) (1 - e^)A m (t) 
7 ••• 

/ ••• 



where < h < f u , • • • , A m (t) G A(A(t)), and Ai(t) + - • -+An(*) 

We denote the above matrix (3) by n(h, Ai(t), • • ■ , A m (t)). 



(3) 
A(t). 



-I mnxmn 



4-1 The Synchronous Consensus 



We first restrict our attention to the simplest case and we study the syn- 
chronous system with time-invariant topology in the absence of time-delays. 
Since there exist no communication delays, we assume that for any i Gl„, 
j G N(G(A(t\)),i), agent i can receive state information from agent j at time 
t{. Therefore N{Q{A{t)),i) = N{G(A(t)),i), Af(t{,i) = N{G{A{t k )),i), and 
A(t) is time-invariant. For simplicity, notations A and A are used instead of 
A(t) and A(t). Apparently, {f k } = {t k }. Rewriting system (1) yields that for 
any % G X„, t G [t k ,t k+1 ) 



Xi(t) = 

Then we have 



-Xi(t) + EjeM(g(A),i) *ijXj(t k ), if M(Q(A),i) ^ 0; 
0, otherwise. 



x(t k + h) = (e~ h I + (1 - e- h ) A)x(t k ) 

= ((l-e- h )(A-I) + I)x(t k ), 1 ' 

where < h < r k and I is the identity matrix with compatible dimensions. 

The following theorem characterizes the consensus property of synchronous 
system (4). 

Theorem 1 System (4) solves a consensus problem if and only if G{A) has 
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a spanning tree. In addition, the group decision value is uniquely determined 
by G(A) and the initial state. 

The sufficiency of the first part is a direct consequence of Theorem 3, and we 
only prove the necessity and the second statement. 

Proof: The necessity is shown first. If G(A) has not any spanning tree, then 
there will be several subsystems, among which there will not be information 
communication, and thus system (4) will not solve any consensus problem. 
Next, we prove the second statement. Because A is a stochastic matrix, there 
exists an / e R™, / > 0, such that f T l = 1 and f T A = f T ( Theorem 1, [32]). 
Let x(x) = fx. 

X (x(t k + h)) = f{(l - e' h )(A - I) + I)x(t k ) = fx{t k ) = X (x(t k )). 
Therefore, x( x ) is time-invariant. 

Suppose that the final state is la, a G R. We have that lim^oo x(t) = la and 
lim^oo x(x(t)) = x(la) = f T la = a. It follows that the group decision value 
a = x(x(0)), which is uniquely determined by G{A) and the initial state, and 
the consensus function is x( x )- 

Now, we give an example to show that the assumption of the existence of 
upper bound f u of update intervals is necessary. 

Example 1 (Counterexample) Consider the synchronous case and let n = 

[o ll , „ 

2 and A = .If update intervals r = In 8, t± — In 16, • • • , r k — In 2 k+i , 

1 

• • • , and the initial state x(0) = [1, — 1} T , then we obtain that 

lim \t k+ i — t k \= lim ln2 fc+3 = oo, 

k~*oo k— too 

and 

xi(t ) - x 2 (t ) = 2; 
x 2 (*i)-a:i(*i) = 2(l-^); 

x 1 (t 2 )-x 2 (t 2 ) = 2(l-h(l-l); 



For any k > 1, we have 

Mh) - x 2 (t k )\ = 2(1 - - i) ••• (l - J^) 

11 l 

> 2(1 - ^ - g 2fc+T^- 
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Therefore, lirm^oo \xi(t k ) — X2(t k )\ > 2(1 — 0.5) = 1. Consequently, the states 
of agent 1 and agent 2 will never reach consensus. 



4-2 The Asynchronous Consensus 



" jli —I 

Mj I 

1 I I ,„ 

Tin ~" *7 

Hi i 



t 



t l t 2 



t, 



Fig. 1. Update times in asynchronous systems without time-delays. 



4-2.1 The Case Without Time-Delays 

Consider the asynchronous case of system (1). Lemma 1 gives a proper char- 
acterization of update times, which is important in the forthcoming analysis. 
From Assumption (Al), we have the following fact 

Lemma 1 Consider system (1). For any i G T n , the number of elements in 
set {tj : tj G [t\, t\ +1 )} is no greater than ([^J + — 1) + 1 denoted by fa, 
where [^J is the maximum integer no greater than -y. 

Proof: By Assumption (Al), we have that t l k+1 — t k < f u . For any j G T n ,j ^ i, 
agent j updates state information of its neighbors at most [f^J + 1 times in 
time interval (t k ,t k+1 ). And there are n — I possible js. Take t k into account 
and therefore the number of elements in {tj : tj G [t l k ,t k+l )} is not greater 
than (|&J +l)(n-l) + l. 

For agent i, i G T n , and update time t k , k > fa — 1, there exists s G Z + such 
that t\ < t k < t k+ i < t l s+l . By solving equation equation (1), we have that 

Xi(t k+ i) = e~ Tk Xi(t k ) + (1 - e~ Tk ) a ij( t i) x A t i)^ 

jeAT{ti,i)u{i} 

where a i3 -(t*) = aij(t k ). 

By Lemma 1, t s > t fc -m+i- Let j/(A;) = [x(t fc ) T , x(t fc _i) T , • • • , x(t k _ rh+1 ) T } T , 
where k > fa—1. From the above discussion, there exists a matrix Tr(r k , Ai(t k ), ■ ■ ■ , 
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Am(tk)) G U(rh,t k ) such that 

y(k + 1) = 7r(r fe , A 1 (t k ), • • • , Arn(t k ))y(k). (6) 

Proposition 3 System (1) solves a consensus problem if and only if system 
(6) solves a consensus problem. 

Proof: The necessity follows from the definition of state variable y(k). Assume 
that system (6) solves a consensus problem. Let a G R such that lim^oo y{k) = 
la. For any i G X„, x t (t) - Xi {%) = (1 - e~^)(E] =1 ^(4)^(4) - ^(4)), 
where t\ < t < t l k+1 . Since t\ — > oo as t — > oo, lim t _ >00 (X]™ = i a i:/(4) x i(4) ~ 
Xi(t\)) = lim^oo X)"=i (4) (^i (4) — (4) ) = (forlim^ 0O (a; i (4)-^(4)) = 
a — a = 0), that is, lim^oo (xj (£) — a+(4)) = 0. Therefore, for any % G X„, 
lim^oo Xi(t) = a, and system (1) solves a consensus problem. 

The following theorem is also a consequence of Theorem 3. 

Theorem 2 If there exists T > swc/i that for all t° > 0, the union of graph 
Q°(t) across interval [t°, t°+T] contains a spanning tree, then system (1) solves 
a consensus problem. 

4.2.2 The Case With Time-Delays 

As a parallel with Lemma 1, we present the following lemma. 

Lemma 2 Consider the asynchronous case of system (2). For any i G X n , k G 
Z +; the number of elements in set {tj : tj G [4>4+i)} is not greater than 
rhn(K(n — 1) + 1). We let m = mn(K(n — 1) + 1) and m = (K + l)rh; 

Proof: Obviously, there can not be infinite elements in {tj : tj G [4>4+i)} by 
Assumption (Al) and (A3). We work out one upper bound of the number of 
elements in this set. 

For any i, let {t k l) } = {% - r^k G Z+,j G N{t k ,i)} U {4}. Given k G 
Z + ,i G X n , by Assumption (A3), all possible elements in {t k ^} fl (4>4+i) are 

4+i — T ij +1 ^j e ■^'(4+1)*)) 4+2 ~~ r ij +2 'i e ■^'(4+2)*)) ■ ■ ■ 5 4+k — T tj +K £ 

N(t k+K ,i). Because |A/"(4',^)I < ^ — 1 for any A;', where |A/"(4',^)I is the 
number of elements in set M(t k ,,i). Therefore 

\{tl l) }n[tlA + i)\<K(n-l) + l. (7) 

Let % G X n , k G Z + be given. By Lemma 1, |{4> : t 3 k , G [4>4+il> ^' e 2+, j e 
X„}| < m + 1. Let its elements be ,t m '+i such that t k i < 4'+i, 

k' — 1, 2, • • • , m', where m' < m. For any k' G {1, 2, • • • , m'}, j G X n , there 
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exists k" such that t 3 k „ < t k > < t k > +1 < t 3 k „ +1 . From (7), 

\[t k ',h' + i) n {#>}| < | [££,,, ££,, +1 ) n < K(n + i) + 1. 

Since {tj : £,■ G = U*Li ([4', H (u« =1 {4 j) })) , |{£, : ^ G 

[4,4+i)>l < ^(i^(r,- 1) + 1). 

For agent i and any e I +) k > m — 1, there exists s such that t\ < t k < 
tk+i < £3+1, and agent z's dynamics can be written 



ii(t) = < 



^emU) a iM)( x M - Tfj) - Xi(t)), if N(ti,i) + 0; 
0, otherwise, 



where £ G [tfc,£fc+i)- From Lemma 2 and Assumption (A3), £fc_m+i < £s — t^-. 
Let r/j = 0. Solving the above equation gives 

Xi(t k+1 ) = e- Tk Xi{t k ) + (1 - e~ Tk ) Yl (luil^-i-jii: - r?-)- 

jeA/"(tj,i)u{i} 

Let = [x{t k ) T , x(£fc_i) T , • • • , a;(£fc_m+i) T ] T - For any A; > m— 1, there exists 
a matrix 7r(rfc, Ai(£fc), • • • , A„(4)) G II(m, t k ) such that 



z(A; + 1) = 7r(r fe , Ai(£ fc ), • • • , A^(£ fc ))2;(fc). 



(8) 



With the same arguments as Proposition 3, we have 

Proposition 4 System (2) solves a consensus problem if and only if system 
(8) solves a consensus problem. 

Now, we present the main result of this paper. 

Theorem 3 // there exists T > such that for all £° > ; the union of graph 
G°(t) across interval [£°,£° + T] contains a spanning tree, then the time-delayed 
system (2) solves a consensus problem. Moreover, ifQ(A{t)) is time-invariant, 
then the solvability of the consensus problem of system (2) implies thatQ{A{t)) 
contains a spanning tree. 

Remark 4 The second part of Theorem 3 is obvious. In order to prove Theo- 
rem 3, it suffices to prove the possession of consensus property of discrete-time 
system (8) under the hypothesis of Theorem 3. However, the proof of consensus 
property of system (8) is not easy. The following two properties of system (8) 
make all previous results, such as those in [8,16], inapplicable to our system, 
and therefore we have to explore another efficient way. 

(1) U(rh,t k ), the set including all possible state matrices n(T k ,-), is not a 
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finite set, and furthermore is not compact because that Ta is an infinite 
set and r k G (0, t u ], which is not compact. 
(2) The diagonal entries of any ir(r k , •) are not all non-zeros. 

Since U(rh, t k ) is a infinite set, system (8) can be viewed as a discrete-time 
consensus model with the topology that switches among an infinite set of di- 
rected graphs. Therefore, previous results on discrete-time systems with finite 
available topologies, such as those in [6,7,8], are not applicable. The only gen- 
eral result touching on infinite available topologies was given in [16], while 
some of the basic pre-requisitions such as the assumption of the compactness 
of ek(A(t))(x) and the assumption of the strict convexity (namely, (3) of As- 
sumption 1 in [16]) are not satisfied by our model (See Assumption 1 in [16]). 

The proof of Theorem 3, presented in the next section, is on the basis of the 
spacial structures of U(m, t k ) and properties of {t k }. 



5 Technical Proof 

This section presents a complete proof of Theorem 3. We first give an equiv- 
alent formulation of the condition in Theorem 3. 

Lemma 3 The existence ofT>0 such that for all t° > 0, the union of graph 
G°(t) across interval [t°,t° + T] contains a spanning tree, is equivalent to the 
condition that there exists e g Z + and r v > with the following property: 

For any U k = {t kc+ i, tke+2, • • • ,ttk+i)e}, there exists a subset ofUk, denoted 
by V k , such that the union ofQ°(t) on V k contains a spanning tree and for any 
ts ^ Vk, i s +i — t s > T v . 

Proof: The sufficiency is rather straightforward and only the necessity is 
proved. By Lemma 2, there exists p G Z + such that for any k G Z+, tk+ p — tk > 
T, such as p = rh([^\ + 2) (For any given i G X„, there exists k' such that 
4' < t k < and \ - f fe , +1 > f u (| - 1) = f u (Lf J + 1) > T. We claim 

rh u 

that t k+p > t*, p . If not, \[t k ,,t k , +JL ) n {t k }\ > \[t k ,t k+p \ n {t k }\ = p + I. 

rh rh 

But by Lemma 2, |[tjj.,, t % k ,.p_) D < = p, which is a contradiction. 

Therefore t k+p — t k > t % k ,,v_ —t k > t l k ,,p_ —t l k , +1 > T). Let e = p + 2fh. We con- 

rh ' rh 

sider U k . Obviously t kc+ m+ p — t kc+r n > T. Therefore the union graph Q°(t) on 
{tkc+m, • • • , ^fcc+m+p} contains a spanning tree. Let the edge set of the span- 
ning tree be S. If (vj, Vj) G £ , there exists k' such that k e +m < k' < ke +m+p 
and (vj,Vi) G Q°(t k >). For t k >, there exists k" such that t\„ < t k i < t l k „ +1 , and 
thus (vj,Vi) is an edge of the graph Q°(t), t G [t k ",t l k ,, +1 ). 
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We claim that t\„ > t kc+ i and t\„ +1 < t( k+ y e . In fact, if t\„ < t kc +i, 
then \[t k „,t\„ +l ) n {t k }\ > \[t ke+1 ,t k >] n {t k }\ > \[t ke +i,tke+m] n {t k }\ = rh, 
which contradicts Lemma 2. And if f k „ +1 > t^+i)e, then \[t k >r,t % k „ +1 ) n {tfe}| > 

c+m+pi ^(fe+i)c] n{tfc}| — m + 1, which also contradicts 

Lemma 2. 

Since {t k } n [^»,^fc»+i) has at most m elements, there exists t s G {t^} fl 

[4»,4»+i) C £4 such that £ s+1 - t a > *' fc " + l t " tlfc " > |. Let f„ = f . If (vj,Vi) 
takes very possible edge in S, we obtain all possible t s s. Let the set of them 
be V k . Then V k has the aforementioned property and the necessity is proved. 

Let A, B be r x r stochastic matrices and let 5(A) 

Thus 5(A) measures how different the rows of A are. If the rows of A are 
identical, 5(A) = and conversely. We say that A, B are of the same type, 
A ~ B, if they have zero elements and positive elements in the same place. 
Let n(r) be the number of different types of all r x r SIA matrices. Define 
X(A) = 1 — min^ ^ J2j mm ( a u,j) a i 2 ,j)- ^ ^(A) < 1 we call A a scrambling 
matrix. 

Lemma 4 ([33], Lemma 2) For era/ stochastic matrices A 1: A 2 , ■ ■ ■ , A k , k > 

0, 

k 

S(AiA 2 ■ ■ ■ A k ) < fl X(Ai). 

i=i 

The next lemma generalizes the result of Lemma 4 in [33] . 

Lemma 5 Let A\,A 2 , ■ ■ ■ ,A k (repetitions permitted) be r x r SIA matrices 
with the property that for any 1 < k x < k 2 < k, Yl^l kl A i is SIA. If k > n(r), 
then Yli=i Ai is a scrambling matrix. 

Proof: Since k > n(r), there exist h < k 2 , such that [itiA ~ HiliA- It 
follows from Lemma 10 and rififci+i being SIA that nf=i M is a scrambling 
matrix. Thus Yu=\ A is also a scrambling matrix by Lemma 9. 

To investigate the properties of matrices in U(m,t k ), we introduce some no- 
tations. Let J 7 (A) = YJlLi An, where A = [A^] is an m x rh block matrix and 
A^ E R nxn . Let T s denote the set of square matrices such that A e T s if and 
only if Q(A) contains a spanning tree with the property that the root vertex 
of the spanning tree has a self-loop in Q{A). 

Lemma 6 Let A be a stochastic matrix. If A ET S , then A is SIA. 

Proof: Since A is stochastic, AI = 1 and p(A) = 1. We assume that there 
exists a spanning tree with vertex v kl as its root and (v kl ,v kl ) G £(Q(A)). 
Suppose that subgraph Q s induced by v kl ,v k2 ,--- ,v ks (1 < s < n) is the 
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maximal induced subgraph that is strongly connected. Let the vertices in 
V(Q(A))\{vk 1 ,Vk 2 , • • • , Vk a } be Vk s+1 , • • • , Vk n . Then there exists a permutation 
matrix T such that 



V 




1 






2 




= T 








n 



Therefore, 



TAT' 1 



An A 12 
A21 A22 



where An 



121 



a fc s+ i,fci 



a k n M 



Uk 3 ,kl ' ' ' a k 3 ,k s 
a k s+1 ,k s 



and A 2 2 



A 



12 



a fc s+ i,fc s+ i 



ak u k 



3+1 



a k s ,l a+ i 
a k s+1 ,k n 



By the assumption that Q s is maximal, A\2 = 0. Since Q s is strongly connected, 
An is irreducible. And from (1^,1;^) e > 0. By Lemma 11, 

An is primitive (Its definition is provided in the Appendix) and thus 1 is 
the only eigenvalue of An with maximum modulus. Since 1 is an eigenvalue 
of An, by Lemma 13, 1 is not an eigenvalue of A 2 2- On the other hand, let 
p{A22) denote the spectral radius of A22. By Gersgorin disc theorem, p{A22) < 
1 and by Lemma 14, p(A) is an eigenvalue of A. It follows that p{A22) < 
1. Consequently, 1 is the only eigenvalue of A with maximum modulus. By 
Lemma 13 and that p(A) = 1, it is easy to check that A satisfies the conditions 
of Lemma 12. Let f A = f T such that f T l = 1. Then \im k ^ 00 A k = lf T . 
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Lemma 7 Let Ai, ■ ■ ■ , Am be n x n nonnegative matrices and let 







Aft = 



I 

/ + A 1 ■ ■ ■ A m _ 2 A 

', 



mnxmn 



I + A x A 2 



Am-l A r 















I + A 1 A 2 A 3 ••• At, 







For any i G {1, 2, 

Mi e T s . 



(9) 

m — 1} ; if (J (J 7 (Mi)) contains a spanning tree, then 



Proof: Let N = M 1 -M . Then we have Af< = M l + N. Let g(MA, Q(Mq), and 
Q{N) be with the same vertex set {u±, u 2 , ■ ■ ■ ,u mn } and let £{Q(J-(M i ))) = 
{v u v 2 , ■ ■ ■ ,v n }. Apparently £{Q{MA) = £(Q(M^)) U £(Q(N)). We first inves- 
tigate the edge sets £(Q(M i Q )) and £(Q(N)). For any j G I n , < % < fh - 1, 

{{Uj, U n+ j), (Uj, U 2n +j), ■ ■ ■ , (Uj, Uin+j), 

(u n+ j,U(i+i) n+ j), (u2n+j,U( i+ 2)n+j), ' ' , (U(rh-i-l)n+j , U(m-l)n+j) } C £(G(Mq)). 

Therefore for any j G Z„, there exist paths from Uj to u n+ j, • • • , in 
£(0(A*3)) (See Fig. 2). If there exists an edge (v j7 v k ) G ^(.^(M;))), then 
there exists < s < m — 1 such that (uj +sn ,Uk) G £(Q(N)). Therefore there 
exists a path from Uj to -u^ in Q[M^). It follows that if ^(jF(Mj)) contains a 
spanning tree with root vertex Vj, Q{MA also contains a spanning tree with 
root vertex Uj. Since the entry in the jth row and the jth column of is not 
less than 1, has a self-loop in Q(Mi). Consequently Q(Mi) G T s . Let n(m) 
be the set of matrices 



e- h I + (1 - e- h )A x (1 - e- A )A 2 • • • (1 - e~ h )A m . x (1 - e - ft )A r; 
I ••• 

I ■■■ 



mnxmn 
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m+j 



2)n+j 



in+j 



Fig. 2. Paths starting from Uj in Q(Mq). If [^-^-li = rh — 1, u^m-i j in+J - and 
u (m-i)n+j are the same vertex. 

where < h < t u , and there exists some A G T^, such that Ai, • • • , A m G 

A(A ), and At + h t4„ = A . Since is compact and given any A , all 

possible choices of A±, ■ ■ • , A m are finite, n(m) is a compact set, and for any 
k e Z+, U(m,t k ) C n(m). 

Let Il = {Tli =1 7r(hi,Aii,Ai2,--- ,A im ) '■ 7r(/ij, •) G Il(m), and there exists a 
subset of {1, 2, • • • , e}, denoted by H, such that for any s G H, h s > f v , and 
&(J2ieH Sj=i Aj) contains a spanning tree}, where e and f v are defined in 
Lemma 3. 

Lemma 8 n is a compact set and for any n G n 0; n is SIA. And for any 
k > n{nm), if Ti\, ■ ■ ■ , itk G n , then l~li=i tTi is a scrambling matrix and there 
exists a X(k) G [0, 1), such that \(Y\i = i ^i) < X(k). 

Proof: The compactness of n follows from the following facts 

(1) n(m) is a compact set; 

(2) All possible choices of 7i are finite; 

(3) h s G [T„,f u ], which is a compact set; 

(4) All possible choices of the spanning tree are finite; 

(5) Given the spanning tree and H, let Tli = {I\l =1 ^(h i: A il: • • • ,A im ) : 
ir(hi,-) G n(m), and for any s G H, h s G [f v ,f u ], and G(T,ien E^Li Aj) 
contains the specified spanning tree} is compact. 

We only prove the fact 5) 

Let \H\ = q, q < e. Since the product of e matrices is continuous, it suffices to 
prove that U 2 = {[7r(/ii, A u , ■ ■ ■ ,A lm ), ■ ■ ■ ,7i(h c ,A cl , ■■■ ,A cm )} : n(h u ■) G 
Il(m), and for any s G H, h s G [T„,f u ], and G(J2ien S^=i Aij) contains the 
specified spanning tree } is compact. Since 7r(/ij, •) G Il(m), which is compact, 
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it suffices to prove that n 3 = {[ir(hi,A n , • • • , A lrh ), • • • , ir(h q , A q , ■ ■ • , A qrh )] : 
n(hi,-) G II(m), hi G [r„,f u ], z = 1,2, ••• , g, and £(£f =1 Ejli Aj) contains 
the specified spanning tree } is compact. 

Let B^ = [bfj 1 ] G n 3 , p = 1, 2, • • • be a sequence of matrices , and lim^oo B^ = 
B = [bij]. Since n 3 is a bounded set, it suffices to prove that B G n 3 . 

It is clear that lim J ,_ >00 &^ = by. For any i,j G T n , if 6^ 7^ 0, then by the 
definition of Fa, b^ > (1 — e~ T ") Therefore if 6^ > 0, then linip^oo 6^ = 

> (1 _ e~ r " ) ( n _ a 'i)a > 0; an d thus there exists P^- G Z + such that for any 
p > Pij, b\f > 0. If b^ = 0, from lim^oo b^ = b^ = 0, there exists Pij G Z + 
such that for any p > P^, bff = 0. Let P = maXy P^, and then for any p > P, 
S» ~ B. 



Let 5 = [Si, B 2 , ■ ■ ■ , £,], A G R™« x ™«, 1 < % < q . From the compactness of 
Il(m), Si G n(m). If ^ = n(h bi ,Bn, • • • , Pj m ), 1 < z < g, then ft, bi G [f„, fj. 
And from B^ ~ S, £/(Ei=i Ej=i A?) contains the spanning tree. To conclude, 
/>'■ 1L, 

Next, we prove that for any n G Ilo, 7r is SIA. Let n = Ei=i ^(hi, An, • • • , Am) 
and 7i be the associated subset of {1, 2, • • • , e} defined in the definition of Ho- 
Let M be the same as in Lemma 7 and let 



A = 



Al A2 ■ ■ ■ An 

••• 







II <K ■) > U( e ~ hlM o + (1 - e- h ')Di) 
i=i i=i 

e 

>e~ c ^M e + e - (c - 1)fu 2(1 - e^)(^o)^ 1 A(M ) c ^ 

i=i 

>e- cfu M c + e - (c - 1)fu (l - e"^) 2 AMP 
>min{e- ef ",e- (e - 1)f »(l - e^)}(M c + ^ AM e_i ). 

The second inequality follows from < /ij < f u , the third follows from 
Mq~ x Di > Di, and the fourth follows from hi > f v ,i G 7Y. 
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From ^(AMo 6 - 4 ) = .F(A), we have AM e -) = E* eW ^(AMJ"') = 

EienF(Di) = EiewEJLiAj- Since G(J2ien E£=i A?) contains a spanning 
tree, C?(.F(E ieW AM e_i )) also contains a spanning tree. Let iV G [R™" xrfm 
be with the same first n rows as J2ien AM} ~* and all other rows are zeros. 
Then Ui=i^( h h-) > min{ e - ef ", e -( e - 1 ) f «(l - e"^)}(M c + N). By Lemma 7, 
Mq + iV G T s , and thus 7r G T s . 7r is also stochastic, and therefore, by Lemma 
6, 7i is SIA. 

With the same arguments, we can conclude that for any 1 < k\ < k 2 < k, 
n£fci n i i s SIA (We only need to replace e by (k 2 — ki + 1) e in the above 
arguments and 7i be the index set associated to any as defined in the 
definition of Il ). By Lemma 5, for any k > n(nrh), l\i=i is a scrambling 
matrix. Let 

\(k) = max A (TTvfi) • 

l<i<k 

Since n is a compact set and A(-) is continuous, X(k) exists and \(k) < 1. 
Obviously X(Ui=i ^) < K k )- 

Proof of Theorem 3: 

For any k G Z+, let n k = nf^S-i^^.^W.^W/^^W). By 
Lemma 3 and Proposition 2, tx^ G n . 

Let p = n(rhn) + l. For any q > pe, there exists s G Z+ such that g = spe 
where < q' < pe. By Lemma 4, 

g+m-2 s-1 (i+l)p-l 

5( ]J 7r(r,,A 1 (t fe ),--.,A A (t fc )))<nA( II *i) < (*(?))*■ 

k=rh— 1 i=0 i=«P 

Therefore 

q+rh— 2 

hmo"( H 7r(r fc , Ai(t fc ),--- ,A A (t fc ))) = 0, 

k=m— 1 

which implies that there exists a G R such that lim^oo njUm-i ^(^i ^i(^fe)) * ' ' > ^m(*fc)) — 
la. And thus system (8) solves a consensus problem. 



6 Simulations 



In this section, we take some examples to illustrate the effectiveness of our 
results. 

Example 2 (Fixed topology without time-delays) Suppose that the sys- 
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tern consists of 4 agents. Let A 



f u = 0.2 and f u = 0.9. And sup- 



110 
10 
10 

o o 1 o_ 

pose that there do not exist communication time-delays and each agent can get 
all its neighbors' states at its update times. For any i G T n , f k+1 — 1\ is evenly 
distributed between 0.2 and 0.9. Since the communication topology has a span- 
ning tree, the consensus is reachable under asynchronous consensus control 
strategy (1). Let initial state x(0) = [5,6,7, 8] T . In the simulation experiment, 



the update times t 



1,2,3,4, are randomly generated and independent of 



each other. The state trajectories of agents are shown in Fig. 4- 



As a marked difference from the synchronous case, the final states of agents 
are dependent on the update times. We repeat the simulation experiment 100 
times independently, and the final states of them are shown in Fig. 5. 




Fig. 3. g{A) in Example 2 




Fig. 4. State trajectories of agents in Example 2 

Example 3 (Fixed topology with time-delays) We still consider the sys- 
tem in Example 2 and suppose that there exist communication time-delays 
bounded by and each agent can get all its neighbors' states at its update 
times. We let initial state x{t) = [5,6,7,8], t G [—^,0]. Fig. 6 and Fig. 7 
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Fig. 5. Final states of different experiments in Example 2 




Time 



Fig. 6. State trajectories of agents with Td = 2 



show the state trajectories of agents with maximum communication time-delay 
r d = 2 (K = 10) and r d = 10 (K = 50) separately, where the time-delays are 
randomly generated. We can see that the system with Td = 2 converges faster 
than the system with Td = 10. // we adopt the-most-recent-data strategy, we 
can get better convergence rate. Fig. 8 and Fig. 9 show the state trajectories 
of agents under the-most-recent-data strategy with randomly generated time- 
delays bounded by Td = 2 and Td = 10 separately. 

Example 4 (Switching topology with time-delays) We still consider the 
system consisting of 4 agents. Each agent's update intervals are evenly dis- 
tributed between 0.2 and 0.9, and are randomly generated. Suppose that the 
maximum time-delay Td = 2, and initial state x(t) = [5, 6, 7, 8], t G [—7^, 0]. 

We assume that the weight of each edge of the communication topology is 1 
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agent 1 

agent 2 

agent 2 

agent 4 









30 
Time 



Fig. 7. State trajectories of agents with = 10 




Fig. 8. State trajectories of agents by the-most-recent-data strategy with = 2 



and 



(1) agent 1 can get the state of agent 2 at update times t\ k , k G Z + , and can 
get the state of agent 3 at update times t\ k+2 , k G Z + ; 

(2) agent 2 can get the state of agent 1 at update times t\ k+1 , k G Z + ; 

(3) agent 3 can get the state of agent 2 at update times t\ k+2 , k G Z-l: 

(4) agent 4 can get the state of agent 3 at update times tf k+3 , k G Z 



+ • 



Theorem 3, this system solves a consensus problem. The state trajectories 
of agents are shown in Fig. 10. 
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Time 

Fig. 9. State trajectories of agents by the-most-recent-data strategy with = 10 




agent 1 

agent 2 

agent 2 

agent 4 



5 1 1 1 1 1 1 1 1 

5 10 15 20 25 30 35 40 

Time 

Fig. 10. State trajectories of agents in Example 4 
7 Conclusion 



We presented an asynchronous consensus control strategy, which is of obvious 
applications in realistic networks. By employing the tools from the nonnegative 
matrix theory and graph theory, we performed the convergence analysis of 
our consensus algorithm. The introduction of communication topology Q°(t) 
facilitated our analysis and it established a connection between the actual 
communication topology and our control strategy, and can be viewed as the 
estimation of the actual topology. Examples were provided to demonstrate the 
effectiveness of our theoretical results. 
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A Lemmas 



Lemma 9 ([33], Lemma 1) If one ore more matrices in a product of stochas- 
tic matrices is scrambling, so is the product. 

Lemma 10 ([33], Lemma 3) Let A ± ,A 2 be stochastic matrices. If A 2 is an 
SIA matrix and A\A 2 ~ A\, then A\ is a scrambling matrix. 

Definition 4 A nonnegative matrix A e R nxn is said to be primitive if it is 
irreducible and has only one eigenvalue of maximum modulus. 

Lemma 11 ([30], pp.511, Corollary 8.4.8; pp.522, Problem 5) Let A e 

R" xri be nonnegative and irreducible. If at least one main diagonal entry is 
positive, then A is primitive. 

Lemma 12 ([30], pp.497, Lemma 8.2.7) Let A e R nxn be given, let A G 
R be given, and suppose £ and ( are vectors such that 

(1) At = Xf 

(2) A T C = AC; 

(3) eC = l; 

(4) A is an eigenvalue of A with geometric multiplicity 1; 

(5) |A| = p(A) > 0; and 

(6) X is the only eigenvalue of A with modulus p(A), 

where p{A) is the spectral radius of A. Define L = ££ T . Then (X~ 1 A) k = 
L + (A"M - L) k -> L as k -> oo. 

Lemma 13 ([8], Lemma 3.4) Let A be a stochastic matrix. Q{A) has a 
spanning tree if and only if the eigenvalue 1 of A has algebraic multiplicity 
equal to one. 

Lemma 14 ([30], pp. 503, Theorem 8.3.1) If A e R nxn and A > 0, then 
p(A) is an eigenvalue of A and there is a nonnegative vector f > 0, f ^ 0, 
such that Af = p(A)f. 
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